Tanaka et al 



Page 1 of 20 



FIG.1 



IV 112sERVER#0 1^4 j^10 121 1 ^2 ^ SERVER#1 7^ ^j "^ J,20 




LAN 

ADAPTOR 



I/O 

ADAPTOR 



;I18 
127 



MAIN 


NODE 


MEMORY 


CONTROLLER 



LAN 

ADAPTOR 



I/O 

ADAPTOR 




DAT A FRAME \ I/O P ASS(FC) 
197 



130-^ COMMAND 



OS #2 



WWN=00O 



170^ 



140- ] COMMAND 
DATA FRAME 



DISK APPARATUS 



IS 



1/0 PASS(FC) 
198 



i7i---n 



I/O 

ADAPTOR 



172- 
175 



LOCAL MEMORY 



EXCLUSION/ 
PRIORITY 
CONTROL TABLE 



184> 

1 SB- 



CHANNEL 
CONTROLLER 



I/O 

ADAPTOR 



LOCAL MEMORY 



EXCLUSION/ 
PRIORITY 
183—- CONTROL TABLE 
181- 



CHANNEL 
CONTROLLER 



SHARED MEMORY 



EXCLUSION/ 
PRIORITY 
CONTROL TABLE 



I 



1 



CACHE 
MEMORY 



I 



I DATA#0 \ ~-^^ 
I DATA#1 Y ^^^ 



/18e 
.187 
.188 



DISK CONTROLLER | 
: .. 1 ^ I nrsir'Ai \ir\\ i \\Ku#r\ ^ - 



MAGNETIC 
DISK 



C LOGICAL VOLUME#0~ 
^ II II 

C LOGICAL V0LUME#1 



Tanaka et al. 



Page 2 of 20 



FIG.2 



111 "2SERVER#0 114 110 121 1 22 sERVER#l 7^ 120 



CPU 
#00 



CPU 

#01 

0S#2 



CPU 
#02 



CPU 
#03 



MAIN 
MEMORY 



NODE 

CONTROLLER 



I/O 

ADAPTOR 



;i6 

12! 
118 



5«E 



CPU 


GPU i 


CPU 




:cpu 




#10 


#11 


#12 




#13 




LOS#0-' 










i 



MAIN 
MEMORY 



-16 



NODE 
CONTROLLER 



I/O 

ADAPTOR 



128 



, DATA FRAME \ I/O PASS(FC) 
130 — 



200-^ — COMMAND 



1,0 



205 1 WWN=0O0 



140- 

DATA FRAME 



210-^ COMMAND 



\ DIS 



DISK APPARATUS 



i 



2^0 



VOPASSCFC) 225 
'198 



I/O 

ADAPTOR 



LOCAL MEMORY 



EXCLUSION/ 
PRIORITY 
CONTROL TABLE 



I/O 

ADAPTOR 



CHANNEL 
CONTROLLER 



I 



LOCAL MEMORY 



EXCLUSION/ 
PRIORITY 
183-^- CONTROL TABLE 
181- 



CHANNEL 
CONTROLLER 



DISK CONTROLLER 



C LOGICAL VOLUME#0~ 
^1 I " 

C LOGICAL VOLUMEiP 



Tanaka et ai. 



FIG.3 



EXAMPLE OF 300 
DATA FRAME ^ 



EXAMPLE OF FRAME HEADER 



START OF FRAME 



FRAME HEADER 



END OF FRAME 



_^305 




DESTINATION ID 


330 


SOURCE ID (WWN) 


.335 


UPPER LAYER PROTOCOL TYPE (SCSI) 


^340 


UPPER LAYER PROTOCOL SEQUENCE ID 


345 


FRAME NUMBER IN SEQUENCE 


^350 


RELATIVE OFFSET 


.355 


^ EXAMPLE OF PAYLOAD (SCSI) 




GROUP CODE 


^360 


COMMAND CODE 


__365 


LOGICAL VOLUME NUMBER (LVN) 


.370 


LOGICAL BLOCK ADDRESS 


.375 


LPAR-ID 


^380 


DATA LENGTH TO BE TRANSFERRED 


.385 


, CONTROL BYTE 


390 



Tanaka et al. 



Page 4 of 20 



FIG.4 



110 



411 

^ SERVER#0 



412 



413 



MIDDLEWARE/ 
APPLICATION 



MIDDLEWARE/ 
APPLICATION 



MIDDLEWARE/ 
APPLICATION 



MIDDLEWARE/ 
APPLICATION 



OS(LPAR-ID 0) 
DEVICE DRIVER 
ADDRESS#0 — 



OS(LPAR-ID 1) 
DEVICE DRIVER 
ADDRESS#1 



OS(LPAR-ID 2) 
DEVICE DRIVER 
ADDRESS#2 



OS(LPAR-ID 3) 
DEVICE DRIVER 
ADDRESS#2 



~~r- 



- READ/WRITE 



421 



HYPERVISOF 
^GIVING LPAR-ID 
/ \ 
EVERY INITIALIZATION EVERY I/O ACCESS 



423 



430 

J 



DEVICE DRIVER 

#0 VTT^iTr:^:!^ 



450 \ 



DEVICE DRIVER 

#1 I , r.Kr^ ■r^4.. 



DEVICE DRIVER 
#2 



LPAR-ID#2/3 



450 '440 
CONTROL FRAME 



STORAGE (/i PROGRAM) 



^130 ^DATA FRAME M42 



COMMAND 


LPAR- 


ID#2 


WWN= 


:001 



461- 



1/0 ADAPTOR ; 



CHANNEL 
CONTROLLER /i P 



DERIVING^ 
LPAR-ID ^ 



SETTING TABLE 



470 ^80. 



CHECKING 
AUTHORITY 



SETTING 

TABLE 

PROGRAM 



LOCAL MEMORY^ 



EXCLUSION/ 
PRIORITY 
CONTROL TABLE 
#2=f #0,#1 } 
#3=1 NON } 



184^ 
185^' 



SHARED MEMORY^ 



EXCLUSION/ 
PRIORITY 
CONTROL TABLE 



CACHE 
MEMORY 


LOGICAL 


DATA#0 




VOLUME#0 


DATA#1 



.187 
.188 



Tanaka et al. 



FIG.5 



411 412 

SERVER#0 ^ 



413 



MIDDLEWARE/ 
APPLICATION 



MIDDLEWARE/ 
APPLICATION 



MIDDLEWARE/ 
APPLICATION 



MIDDLEWARE/ 
APPLICATION 



OS(LPAR-ID #0) 
DEVICE DRIVER 
ADDRESS#0 ^ 



OS(LPAR-ID #1) 
DEVICE DRIVER 
ADDRESS#1 

V 



OS(LPAR-ID #2) 
DEVICE DRIVER 
ADDRESS#2 



OS(LPAR-iD #3) 
DEVICE DRIVER 
ADDRESS#2 

- READ/WRITE 



421 



EVERY INITIALIZATION 



HYPERVISOl 
^GIVING LPAR-ID 
/ \ 



422 

EVERY I/O ACCESS 



T. 

423 



430 



DEVICE DRIVER 

#n I 1 

LPAR-ID#0 



4^0 ^4 



DEVICE DRIVER 

#1 I 

LPAR-ID#1 



DEVICE DRIVER 
#2 



LPAR-ID#2/3 



450 "440 
CONTROL FRAME 



60. 



^130 ^TDATA FRAME ^442 



STORAGE (// PROGRAM) 



461^ 



I/O ADAPTOR fx P 



CHANNEL 
CONTROLLER /u P 



DERIVING. 
LPAR-ID ^ 



SETTING TABLE 



470 



80. 



CHECKING 
AUTHORITY 



SETTING 

TABLE 

PROGRAM 



LOCAL MEMORY^ 



EXCLUSION/ 
PRIORITY 
CONTROL TABLE 
#2={ #0,#1 } 
#3=1 NON } 



84^ 



SHARED MEMORY V 



EXCLUSION/ 
PRIORITY 
CONTROL TABLE 



CACHE 
MEMORY 


^LOGICAL 


DATA#0 Pj 




> VOLUME#0 


DATA#1 1^ 



STATUS 



.187 
.188 



Tanaka et al. 



fage 



FIG.6 



EXCLUSION/PRiORiTY CONTROL TABLE [LOGICAL VOLUME#0] ^ 







LPAR#0 


LPAR#1 


LPAR#2 


LPAR#3 


50& 


WWN#0 


O 


X 


X 


X 


510 


WWN#1 


X 


PRIORITY 
CONTROL 


EXCLUSION 
C0NTR0L#2 


X 


515 


WWN#2 


O 


O 


X 


X 


520 


WWN#3 


X 












1 

525 


530 


5i5 


540 



Tanaka et al. 



Page? of 20 



FIG.7 



EXAMPLE OF 
CONTROL HEADER 



LOCAL NETWORK 
HEADER 



UDP HEADER 



LOCAL NETWORK 
TRAILER 



600 
_^605 

^610/ 

615/ 



EXAMPLE OF MESSAGE HEADER 



COMMAND FIELD (TABLE SET) 



DATA LENGTH FIELD (6) 



DATA FIELD (LOGICAL V0LUME#2) 



DATA FIELD (LPAR-ID#2) 



DATA FIELD (WWN#1) 



DATA FIELD (EXCLUSION C0NTR0L#2) 



DATA FIELD (MAX EXCLUSION TIME) 



DATA FIELD (MAX NUMBER OF I/O 
REQUESTS EXCLUDED) 



Tanaka et al. 



Page 8 of 20 



FIG.8 




Tanaka et al. 



Page 9 of 20 




Tanaka et al. 



Page 10 of 20 



FIG.10 




Tanaka et al. 



Page 11 of 20 



FIG.11 




Tanakaefa/. Page 12 of 20 



FIG.12 




Tanaka et al. Page 1 



FIG.13 




121 5 



Tanaka et al. 



Page 16 of 20 



FIG.16 



411 

^ SERVER#0 



412 



413 



MIDDLEWARE/ 
APPLICATION 



MIDDLEWARE/ 
APPLICATION 



MIDDLEWARE/ 
APPLICATION 



MIDDLEWARE/ 
APPLICATION 



OS(LPAR-ID 0) 
DEVICE DRIVER 
ADDRESS#0 



OS(LPAR-ID 1) 
DEVICE DRIVER 
ADDRESS#1 



OS(LPAR-ID 2) 
DEVICE DRIVER 
ADDRESS#2 



OS(LPAR-ID 3) 
DEVICE DRIVER 
ADDRESS#2 



LPAR- 


-ID#0 


LPAR- 


-iD#1 



-ACCESS PERMITED \ \ ACCESS DENIED 
^ 421 422 ^ ' 



-READ/WRITE 



^1510^ HYPERVISOR'* 

(CHECKING AUTHORITY) 



EXCLUSION!/ 
PRIORITY 
CONTROL TAE 



y 

423 



DEVICE DRIVER 
#0 



DEVICE DRIVER 
#1 



DEVICE DRIVER 
#2 



DATA FRAMET 



460, 
46V 

462—] 



STORAGE (Af PROGRAM) 



I/O ADAPTOR n P 



CHANNEL 
CONTROLLER ju P 



LOCAL MEMORY 



84-^ 



SHARED MEMORY 



CACHE 
MEMORY 



I DATA#0 y - ^496 
I DATA#1 [ --^497 



Tanaka et al. 



Page 17 of 20 



FIG.17 



110 



APPLICATION#0 
(APL-ID#1) 



1 605 1 61 0 

SERVER #0 ^ 



APPLICATI0N#1 
(APL-ID#1) 



APPLICATION#0 
(APL-ID#0) 



APPLICATI0N#1 
(APL-ID#1) 



OS(LPAR-ID#0) 

DEVICE DRIVER ADDRESS#0 



0S(LPAR-ID#2) 
DEVICE DRIVER 



HYPERVISOR 



~422 



ADDRESS#2 

— READ/WRITE - 



430 

J 



DEVICE DRIVER 

#0 I , r^Ao ■r^^.n 



4I0 \ 



DEVICE DRIVER 
#2 I , ^ , „ 



450 ^440 
CONTROL FRAME 



-1620 
46( 



461— 



STORAGE {^ PROGRAM) 



635^DATA FRAME ^^42 



COMMAND 


WWN= 


=001 


LPAR- 


ID#2 


APL-ID#1 



I/O ADAPTOR n P 



CHANNEL 
CONTROLLER ^ P 



DERIVING^ 
LPAR-ID ^ 



SETTING TABLE 



^70 1 80^ 



CHECKING 
AUTHORITY 



SETTING 

TABLE 

PROGRAM 



LOCAL MEMORY^ 



EXCLUSION/ 
PRIORITY 
CONTROL TABLE 



1625- 

184^ 

, EXCLUSION/ 

1630^' PRIORITY 

CONTROL TABLE 



SHARED MEMORY V 



186 


CACHE 
MEMORY 


LOGICAL 


DATA#0 Pj- 


-187 






VOLUME#0 


DATA#1 y 


^188 



Tanaka et al. 



Page i» oi/.v^ 



FIG.18 



EXCLUSION/PRIORITY CONTROL TABLE [LOGICAL VOLUME#0] 
(WWN-LPAR) 







LPAR#0 


LPAR#1 


LPAR#2 


LPAR#3 


505 — ~ — 


WWN#0 


o 


X 




X 


510 — ~ — 


WWN#1 


X 


PRIORITY 
CONTROL 


EXCLUSION 
C0NTR0L#2 


X 


515-^ ■ — - 


WWN#2 


o 




X 


X 


520^ ■ 


WWN#3 


X 












525 


530 


5I5 


540 




EXCLUSION/PRIORITY CONTROL TABLE [LOGICAL VOLUME#0] 
(WWN-APL) 






LPAR#0 


LPAR#1 


LPAR#2 


LPAR#3 


1700 


WWN#0 


X 




0 


X 


1705^ ■ 


WWN#1 


X 


PRIORITY 
CONTROL 


EXCLUSION 
C0NTR0L#2 


X 


1710-^ 


WWN#2 


X 




X 


X 


1715 


WWN#3 


X 












17L 


1725 


1730 


i 

1735 



1625-b 



Tanaka et al. 



Page 19 of 20 



FIG.19 



EXAMPLE OF 
DATA FRAME 



START OF FRAME 



FRAME HEADER 



PAYLOAD 



END OF FRAME 



^310 



EXAMPLE OF FRAME HEADER 



Uto 1 ilNA 1 lUN lU 


^330 


oUUKUb lU (,WWNJ 


^335 


UHHcK LAYtK PKU 1 UUUL 1 Yrb toUoU 


340 


UrrtK LATtK rKU 1 UUUL otUUtNOt lU 


.345 




350 


RELATIVE OFFSET 


355 


^ EXAMPLE OF PAYLOAD (SCSI) 




GROUP CODE 


.360 


COMMAND CODE 


^365 


LOGICAL VOLUME NUMBER (LVN) 


^370 


LOGICAL BLOCK ADDRESS 


.375 


LPAR-ID 


380 


APL-ID 


.395 


DATA LENGTH TO BE TRANSFERRED 


.385 


, CONTROL BYTE 


.390 



Tanaka et al. 



Page 20 of 20 



FIG.20 



EXAMPLE OF 600 
CONTROL HEADER ^ 

^605 

,610/ 
615/ 



LOCAL NETWORK 
HEADER 



UDP HEADER 



LOCAL NETWORK 
TRAILER 



EXAMPLE OF MESSAGE HEADER 



COMMAND FIELD (TABLE SET) 



DATA LENGTH FIELD (6) 



DATA FIELD (LOGICAL V0LUME#2) 



DATA FIELD (LPAR-ID#2) 



DATA FIELD (APL-ID#2) 



DATA FIELD (WWN#1) 



DATA FIELD (EXCLUSION C0NTR0L#2) 



DATA FIELD (MAX EXCLUSION TIME) 



DATA FIELD (MAX NUMBER OF I/O 
REQUESTS EXCLUDED) 



